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ABSTRACT 

This Delphi analysis of the "Instructionally 
Effective School** ( lES) vas designed to measure the current state of 
the art and science of school-based teaching and learning for poor 
children, and to describe the policy implications of the 
developmental level for school people, districts, states, and the 
federal government. Teams of experts in each of the component areas 
of the lES circulated inventories to the panel membership, who 
recorded their opinions about each proposition, the confidence level 
of their rstimates, and their basis for judgment. These data wer.^ 
then recirculated, so that panel members could refine their judgments 
and comment on the developing consensus* This methodology is 
described in detail, and results of the analysis are reported for the 
following six contributing factors: (1) teacher characteristics and 
behavior; (2) administrator characteristics and behavior; (3) stude^nt 
body composition; (4) school learning climate; (5) pupil evaluation 
procedures; and (6) curriculum materials. Policy implications are 
then summarized for each of these factor areas. The study concludes 
that substantial improvements have occurred across the board in the 
teaching of needy children. (TE) 
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A DELPHI ANALYSIS OF THE INSTRUCT10H<VLLY EFFECTIVE SCHOOL 



O Dale Mann, Professor and Chainnan 

GO Department of Educational Administration 

Teachers College, Columbia University, New York 



Judith Lawrence, Project Associate 



, Local School Development Project, Board of Education of 

Q the City of New York/ftew York Urban Coalition 

This I>« Ipbi anal yiis of ^^e "Instruct ioul 1 j Effect ive 
School'* ^lES) vsft detigiied first to vtssure the currcBt state of 
the art and science of school-phased teaching and leamiag for 
poor childrra. Second, it iics designed to describe the ^licy 
inplications of the developnental level for school people, 
districts, * states, and the federal goveraent. After an initial 
round that defined and deliaited the problem, teams of experts in 
each of the component areas of the lES circulated propositions! 
inventories to the panel membership. Members recorded th ir 
opinions about each proposition, the confidence level of their 
estimates, and vhere possible the basis on vhich those judgments 
had been resched. These data vere then re-circulated so thst 
panel members had the opportunity to refine their judgments and 
comment on the developing consensus and dissensus* 

The members are listed belov. Tb^y vere selected because of 
their expertise in esch of the areas and because they vere at 
least favorably disposed to the possibility that instruct ionally 
effective schools, according to our definition, did exist. The 
selection criteris for members are appropriate given the purpose 
of meSEuring positive aspects of school practice* This analysis 
would not have been served by documenting again the widespread 
belief that schooling cannot vork for poor children. 

The responsibility for the interpretation in this sunmiary 
should rest vith the authors^ The qtiality of this project is 
Attributable to the hard vork and prodigious cooperation of the 
panel» and they aTl express their own judgments in the team 
reports included here. Vhile Judy Lawrence and 1 did vhat ve 
could to facilitate the work of the teams with drafting and 
tentative analysis, our judgments vert not psrt of the panel's 
opinions. But our opinions ere expressed in this sumxQsry paper. 

Finally* ve need to note vhat should be obvious. Many of 
the areas and issues discussed in this summary are complicated, 
some are subtle, many are inadequately established empirically 
J and quite contentious. The analysis done by each of the teams 

^ reports expert opiuion on these matters. The panel vas aeldom 

unanimous snd disagreement undoubtedly extends to the current 
TV suflamary, interpretation, and recommendations. ofPAMMiwT of ^oucatim 



^ ^ This reports the summary and recCTsendations, prepared by the 

principal investigator, of a project sponsored by the School 
Finance Project of the National Institute of Education. The 
views expressed here are the author's sole responsibility. 
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The Definition Sound 

The IBS should be defined as • school t\ : can increase 
acsdesic achievement for its students vho are frcim low income 
backgrounds. It is unfeasible to expect that a school, by 
itself, can completely erase the relationship between low 
achievement and low income backgrounds but it is not unreasonable 
to expect some improvement for these children. How much is 
enough is a question best answered close to the school* Goal 
setting fihould include j^rents, communities, school boards, and 
school officials and it should be informed by a sense of the new 
possibilities for public schooling* 

Second, •'ef fectiveness" should be measured by achievement on 
norm-referenced standardised tests. The panel clearly rejectea 
career or vocational fates of school graduates as a measure oi 
schooling success (for these purposes) and equally cleaily 
rejected a achool'a reputation or the satisfaction of adults 
(teachers and/or parents) as a measure of instructional 
effectiveness. Test scores accurately erasure literacy and 
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numeracy especially at the baaic level; while wf ab'^uld all 
aspire to additional achicveaenta for all children, thoae things 
are built on a foundation of baaie akilli. 

Can achieveaent be changed by Banipulating (a) within aehool 
variablea (b) within exiatia;^ reaourcea? There it evidence that 
that ia being donii: the i^nel concluded that working on 
alterable variables within exiating reaourcea was a feasible and 
correct agenda for public schools. Thia Delphi inquiry waa begun 
to test the notion that there were things vithin reach of public 
policy Tsakers which could be changed to help kids do better in 
school. The proposition has been Hup'ported in the analysis 
although not with the clarity and weight that had been hoped and 
that may be reached in the future. With reapect to noney we do 
not doubt that more support for schooling for poor children iM>uld 
help and that a lot B»re soney would help a lot. But the 
prosptrct for that is dits at least in part because people believe 
that schools are not able to help poor childreo. Doing better 
v.ith what we have should contribute to iwre adequate aupport. 
And failing to iaprove alterable variables within current 
reaourcea has the unfortunate effect of holding another 
generation of poor children hoatage to a i&ore generous public. 
Thus, schools ahould begin noving toward instructional 
effectiveness because in both the short range and the long range, 
everyone will benefit. 

The panel wss nearly unanimous in Minting to augment achool 
effects with help fron non-school resources, especially parents. 
While that is desirable, we believe that the essence of the 
public policy problem lies with children i#ho do not and will not 
have thoae resources. Current trends indicate that within a lew 
years, half the children of the Dnited States will have 
experienced broken homei* yet few principals have the audacity to 
tell their FTA's that there is not much the school can do to h?lp 
the children of divorce learn in school. School people -ought 
similarly to accept the challenge of effective education for the 
children of poverty. 

The Delphi was organised around a five-part typology which 
is becoming commonplace (administrative factors, teacher 
variables, pupil evaluation, etc. ). It ia important to note that 
the framework waa both adequate and has become commonplav-e. We 
experienced less overlap than expected and with one exception* we 
found no major area that was inadequately configured. The 
typology that was used by this analysis is the same as that used 
by many systems that have tried to bring the lES into practice. 
That encouraging concurrence between scientific and practical 
paradigms is further strengthened by the large number of major 



*The compoaition of a school 'a student body can be changed 
by school policies and thoae changea have an effect on 
achievement. "Student body composition" had originally been 
subsuwed under "school climate" but was eventually separated. 
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•tudiei %Alch, lndep»dtntly» have found tbt Moe att of 
v&riabltt ufeful in atudying the IE8. Eves diicotinting for 
faddifto, that sort of convergenee ii an inportast algnal in the 
maturation of a technology* The asall nuaher of variablea 
coiucidea vith vhmt achool leadera need fron the acholarly 
cossmnity— ^a aet of thinga terae enough to fit on a flag. 

Aa part of the definitional round, the panel vaa aaked to 
estimate bov vuch each of the factora contributed tto 
inatructional ef fectiireneaa. Mot aurpriaingly» teacher variablea 
Iffd the vay but the laat place ranking of apecific curriculum 
materia la came aa a aurpriae. 



Table 2 

Panelists Fio^l Eatimatea of Percent Contributed by Each 
of Six Factors to the Instruct ionally Effective School 

Summarized by Factors 



FACTOR 


MEAN 


MEDIAN 


SD 


TOTAL roiUTS 


1) Teacher characteristics 


25 


25 


7.2 


245 


and behavior 










2) Adrainistrator character- 


24 


25 


14.5 


243 


istics ai<o behavior 










3) Student body composition* 


20 


15 


i9.6 


196 


4} School learning climate 


13 


13 


6.6 


125 


3) Pupil evaluation procedures 


11 


9 


8.4 


106 


6) Curriculum materials 


8 


10 


5.4 


75 



*N. B. Numbers 3 and 4 vere separated for most but not all of the 
analysis. Kost of the lES literature ittresses educating all children 
vho come to the public school regardless of family background. But 
those features can be varied by some policy makers, t.g. , school 
boards draving attendance lines and vhere ve needed attention to that 
sort of phenomenon we moved from five factors to six. 



Virtually all of the lES literature puts the role of the 
school principal first. The panel placed administrator 
contributions second but vfaet asked which factor was most 
reasonable aa a focus for "government action (e.g., legislation, 
mandated derelopment, use as a criterion of eligibility for stat2 
and federal funding...)**, acteiniatrators were re.stored to the top 
of tbe list. Principals are more politicslly vulnerable than are 
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the heavilyimioDised ficultiet of AiMrie«ii tcboolt* and 
principali are officially charged vith fcbool leadership 
f unci ions; hoth character la tic a make it aeaiible to concentrate 
public policy on achool adainittratoriy at leaat initially. 

Interaction a&oi^ the variablea «ay be critical to practice. 
If for euople, one puti in place a finely-grained p^pil 
achievement Maitireoent ayatem, and those data are used 
inappropriately for teacher personnel evaluations, teachers stfy 
withhold their stupport for a achool^vide usprovement effort. 
Must i&provesent be school«-iride? Are teachers or acboola a 
better focus fnr public ^licy? These ia^ortant questions have 
not been clarified by thia analysis for the very good reason that 
the data base th9t ve might have synthesiaed about interaction 
and substitutabi.Hty among the factors as they have been 
•xperienced in the field simply coea not yet eziat. 

Neither ia very mch knovn about the iaatructionally 
effective secondary achool» at least in comparison to vhat is 
knovn about IBS elementary acboola.* Efforts at achool 
improvement are best concentrated in the early gradea because 
younger children have less of a deficit to overcome and because 
success there reduces the necessity of costly efforts at 
remediation later. It is fortuitous that i^ know more about the 
mote important policy levels elementary schooling. 

The definitional round and its iterations (i.e., circulating 
early results vith requests fcr clarification and comment) did 
for the panel about vhat one muld hope for in any school system 
contemplating committing itself to more instructional ly effective 
schooling. The psnel agreed that it vas realistic to inquire in 
more detail about schools that vere helping poor children achieve 
better despite their poverty. The panel might have but did not 
endorse the conventional visdom about the futility of achool 
effects. Second, the psnel agreed on a limited aet of factors, 
those factors ^stayed stable and they illuminated pivotal 
questions of schooling practice. Our interpretations and 
conclusions about each ^f those areas is discussed next. 

Teacher Characteristics and Behavior 

The results of this part of the analysis support the ides 
that more is knovn, more reliably, about more detsiled kinds of 
behsviors vith respect to effective teaching than any other area 
of the lES. Everyone agrees about the importance of 
sdminiitrstive leadership but compared to the specificity of 
knowledge about good classroom practice, leadership prescriptions 



*It is possible, even likely, that many of our findings 
vould be quite different for the secondary school, e.g., the 
place of the curriculum. Unfortunately, secondary schools have 
not hid the aort of results-oriented scrutiny that elementary 
schools have had and thus, a Delphi analysis vould be prn^ature. 
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ftre coustelt of global perfection. 



As Berlinf -Caben point out in tbtir report, "Enpiricftl 
evidence, coamon ecnse, «nd rater judgments nil support Itbe 
iaportsnce of tine nssge] in tbe clsssroon. " Tbst means a faeavy 
allocation of tise-on-task to diract instruction in reading and 
aatb. One .effect of tbat is aiaply to give stud«nti a cbance to 
learn and, »bere saterials are appropriately selected, to 
succeed. 

Tbe second set of iteaas supported by tbe group's judgment 
deals with an overlap between vbat is taught and vfaat is tested. 
CurriculwD sapping and test analysis can both contribute to this 
^lignsent. The effect can be increased where teachers pay 
Attention to vhat has been taught and learned in the child's 
revious grade ("prior learning" vhich is in fact a variable). 

The panel did not believe that effective teachers would let 
their teaching be ahaped by what they like or dislike. While it 
is probably true that the oos^ professional teachers are that 
disciplined, it is also probable that other teachers will need to 
have strong reasons to adopt tmfaniliar techniques. Those 
reasons have both attitudinal and managerial dimensions. 

Another set of items on which there is strong agreement 
dealt with teacher expectancies about student performance: They 
were to be high but attainable, modified periodically, and 
positively reinforced. Hona-ref erenced standards are 
supplemented by other criteria and the cyclical relation between 
learning and its recognition is frequently built in to programmed 
instruction, mastery learning, and computer assisted instruction. 

Sevezal items dealt with the teacher as the "manager" of the 
classroom and stressed the importance of teachers holding 
students accountable for aasignments, handling problems 
simultaneously, keepii^ the pace briak, and monitoring student 
seatwork. One way to summarise this is to say that when teachers 
teacht children learn, and, up to limits which are not now often 
reached the more teachers teach, the taoxt children learn. 

Administrators 

We have already remarked on the panel's departure fr«n the 
conventional wisdom in placing administrators second on the list 
of rank-ordered contributors to the lES. However, they were 
first on the list of useful policy targets probably because of a 
belief that the IIS has to start somewhere and be maintained 
somehow. Administration has always been action at a distance; 
it haa its effect on services through regulations, memos, 
operating routinca, and peraonnel actions, not directly tbroxigh 
tesching children. But is is clear that the panel wants to cut 
that distance and get principals much closer to children and much 
deeper into classrooms. 
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Thert it a itrong fetling that the principal bat baco&e too 
ouch The buaineas Btnager and . too little the inatructional 
leader. Moat oembeira vere villing to aee the {sanag^nt function 
done leas veil, all ntnted ^ainiatratora to do «>re curriculnm 
development and evaluations ttore teacher auperviaion, sore itaff 
development and in general to be far vore involved vitb the 
achool'a teaching and learning aiaaion than ia nov the caae« 
While that* ia undoubtedly deairabl^* ve think that there are 
three very real barriera to acting on that advice« Firat, a 
generation of principal a bai cooe into office vith a dininiabed 
gratp of instruction. To aucceedi one vuat be a credible, that 
ii a knowledgeable inatructional leader. In the XES, 
adniciitratora do more than preaide over the iftgregate of vhat 
teachers are willing to do* Such achoola have a very discrete, 
concentrated agenda and they have a clearly defined ciurriculuo as 
has been documented in. this analyais. If they are to facilitate 
and guarantee its implementation (two very different but often 
crr?!c:::r::;ry functions), principals mast first master the 
content of that curriculum. There are training implications here 
that should involve districts, inatitutions of higher education, 
and professional aasociations. 

Second, teacher unions havf! ''power-equalized" at the 
building level and principals will have to struggle to assert or 
reassert an instructional role. Third, one of the chief toola in 
that struggle is exactly what the panel would have principals 

de-emphasire budget control, personnel management, resource 

allocatiout and the adminia trivia that nonetheless steers 
organications. Ve are encouraged that aome principals are f 
leading lES's and in the **real wrld" of the public school. 

Principals of lES's did not have a aet of descriptive 
characteristics that are unobtainable* They were thought to be 
optimistic people who solved problems and communicated clearly. 
They were thought to be good at structuring teacher rewarda (even 
in the face of union contracts that have unneceaaarily paralysed 
some) and they did much more than im>nitor classroom instruction. 
The panel was not impressed with the principal as a community 
relations expert or aa a grant getter: neither was a necessary 
component of the principal 'a role. 

Vhat was necessary was that the principal set high 
standards, a practice that would depart from the current, 
probably modal practice in which the principal "protects the 
teachers'* from "unreasonable demands.^ Knowing what ia 
"reasonable" dependa on what ia possible. Thus, if the faculty 
IS to believe in the possibility of its work, the school* a 
leaders must first understand the issuea and their potential. 
Schools have been rightly criticised for being adult centered, 
not child centered* Demanding principals will need political 
support and courage. The panel helpfully pointed out that a 
school focussed on basic skills acquisition would have a more 
reasonable aet of goal a than the current goal overload and goal 
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6tud€.^t Bc^y Cmpotitioii Vsriablcs 

Student body cimppiitio«i varUbles caused the aoit 
eoaceptuAl trouble for the pmuml but uuleee that difficulty ie 
overcome, pjeople interetttd in the US my aiei e source of 
isprov»e&t» The problen lay in having to coniider the elate 
atatue of aone children fir at aa a gi^en that defined the IES9 
but second as a variable, parts of lAich vight be sanipulated to 
childr«n*s benefit* The lES may be defined as s school that 
vorks for poor^ children but that does not Man that children from 
other social Classes night not also attend such schools* The lES 
definition treats faoily background as a constsnt, but that saoe 
factor is a variable for scne policy purposes. This part of the 
Delphi looked for contemtual effects, "^o vfaat eatent does 
student body conposition*. .effect an individual student's 
acMUvrwrut, ceteris paribus ?'* 

The overall conclusion of this part of the study is 
melancholy # Those factora iu>st* isportant to achievement are 
hardest to change; those thst are easiest to change are least 
inportsnt. For exaople, the panel concurred that there are 
strong effects on achievemt^nt for a given child according to the 
aocial clsss of that student's classmstes* But school attendance 
lines cannot be changed >y principals. Superintendents, school 
bosrd fMisbers, state officials, (Md judges) csn alter those 
lines and for then the social class composition of a school's 
student body is a policy variable* This finding is one of the 
fev exceptions to the school building focus of the group's policy 
implicstions* Here the challenge is above the service delivery 
level. Interestingly, the saue questions about belief and 
politics vill apply for all actors. 

The psnel believes that big elementary schools dim^nith 
acbieveoeot (a ' little), that all girl schools help girls and 
vomen develop more of their )N>tential, and (stroi^ly) thst 
homogeneous ability grouping diminishes oversll achievement. Of 
the three, only the latter ii cleanly vithin reach of a school 
principsl. 

Some psrent and family relsted factors can become school 
vsriables. The psnel thought there vere slight achievement 
effects from mothers in full-time paid employment and from large 
families with closely spaced children (probably becsuae of a 
diminution of parenting ^contact time"). ; 'ndergarten is comiMn, 
some schools have early childhood programs, a fev schools have 
parenting education activities that sight contribute to school 
achievement. Strictly spesking, the scsrcity of those latter 
practices suggests that they are not vithin-school effects and 
thus should be eacluded from our analysis. Whether that is 
sccepted or not, the exmples may make the point that some 
student body composition vsriables can be changed to good effect. 
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The eollese-going €sp«ctfttions of the H'cbO children, to 

take m final example, ii^hought to be related to aehievesent ajod 
can be shaped, in |»«rt, hy school proceet. 

In t«aeral though, the contestMl «f feetit of student body 
coBposition are not a vajor Rsrt of the ICS. It gets done, if et 
all, in exactly the fashion that should be characteristic of a 
public school with whoever coves to the door. 

School Learning Cliaate 

The productivity of any workplace will be heavily affected 
by the climate of that place, the way the workers feel about each 
other, their bosses, and the work itself. The first item on the 
school cliaate instrunent asserted that in an IES,"The staff 
(believes) in the educebility of MIX students served by the 
iichonl." The panel's unanispns sup^rt for the proposition would 
sot be echoed in nany schools attinded by poor children. There, 
teachers find thesselves nxpected to be instructors, 
disciplinarians, clerks, counselors, and supervisors to large 
groups of children: despite their efforts, asny of those 
tearhers believe that t'oey are unfairly criticised end poorly 
paid. Confronted with a situetion they believe to be over 
deasndiog and under rewarding, auny hove retreated into a 
custodiil definition of their work and explained that, at least 
to themselves, by referring to the research that purports to show 
how little schools csn contribute in the absence of nurturing, 
intact, educating hcoes. Thus, what teachers believe about the 
educability of poor children critically determines how hard they, 
the teachers vill try and through that, 1k>w touch the children 
vin learn. , 

Bote Bene : How hard it is reasonable for teachers to try is 
directly relsted to how effective schooling is at its »ost 
powerful. This Delphi study tested that power and while we urge 
teachers to believe in the educability of all children we hove 
been IwSS successful in aisasaing coeipelling empirical evidence of 
why they should believe that. The conclusion here is not to give 
op but rather to try harder. The evidence does support 
substantial increases in the efforts invested by school people. 
The second conclusion is thst teacbera and administrators are 
right to want to know on what basis they are being asked or 
required to change their practices. We know some good things 
thst work, those should be implemented now, but we also need more 
research. 

Teachers' beliefs that all children can learn ia the first 
half of the educability question. The second half is the 
teachers' belief that they, both individually iM ££ A f^c^Uy. 
can teach lU children. Again, the psnel believes that that sort 
of orgsnirational sense of efficacy is importsntly relsted to 
incressed achievement for poor children. It should be noted thst 
a prior question has to do with the physical safety of the 
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bailding which mitt be itcored before cither ths children or, the 
teachers can attend to school i&g* 'b^> ^* • concern 

than in recent yeara ia dne in so aaall part to the research on 
•chool violence aupported by the Federal govemaent and it a 
inplfoentation in public aehooli. 

If a tjchool ia to have an el'fect it hai to be through core 
than the ef forte of a aiagle outatanding teaches. Children have 
leveral teachera over the grades and inatmction ia aoppotte4 by 
the interaction of d^erent rolea. Aa one s>eaber pot it, t& be 
effective, a achool hSm to be sore than "independent clafaroona 
hrid together by a comaon p«rking lot." The panel a&rongly 
endoraes a ahared uoderttandiag of the achool* ■ purpose and a 
cosoaon effort in that direction. The prevailing norc stresses 
the "professional autonomy** of individual teachers in individual 
classroons. Sixt:( percent of the panel senbers aupported the 
Droposition that so»e of the autonomy ahould give vay to a cloaer 
integration of the achool* a vork among all teachers. 

Clisate neasures ordinarily look at <iuestions of vork 
satisfaction. While the panel had rejected that as a prinary 
outcotse indicator of an IES» it nonetheleas atreased **Borale,*' 
"satiafaction," and •*cohesiveness" aa important facets of the 
lES. The group's easy agreement about thoae things masks real 
questions about schools vh«re adult aatisfaction is adequate and 
arrievement is not, aa veil aa schools ^ere the children* s 
achievement gains have come at the espense uf organitational 
factors auch as faculty cohesiveness and orincipal/staf f harmony. 
Goals set asd enforced above a school 's\current perfosisance may 
riak the happy climate of a achool, at leaat in the transition 
from less to more effectiveness. 

Much 4i£ this is related to leadership in the instruct ionaily 
effective school. The panel endorses collalwrative planning and 
participatory deciaion making,* both of i#hich are likely to 
facilitate the iaplemeotation of the substance of the US. The 
panel also recomiMnds that administrators aacrifice some of their 
buainesB management activities in favor of instructional 
leadership although one wonders what would happen to school 
climate if the principal neglected to forvaid payroll vouchers on 
'ime. 

The lES is an organizational phenomenon Ah well as an 
individual oue. The achool-based culture of teaching must be 
engaged in this work aa well as each teacher 'a individual 
estimate of the possibilities of the profession. 



*In the administration data collection, members made the 
point that leadership might come from tibe teacher ranks in 
addition to, sometimes instead of, the ad^lniatratora. 
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Pupil l^alu«£ioii 



Tbe testing practice! of Asericen educetion are not adequate 
tu support as instruetioiully effective school* The tvo mejor 
diMOsions of testing in en lES are iastructiosul teets» often 
teacher seaep end standardised schievenent tests. The Delphi 
anslysis asphasi&ed the iapottance and contribution of hotb. 

Horn-referenced, nationally distributed, * standardised 
achievessent tests, are often criticiaed but the panel nas 
forthright in recomending them as a metric of a:!hieve»ent irithin 
the IES» Asswing that they arff reasonably aligned vith the 
curriculum as taught, and aasiaii^ that their results are used 
appropriately, they provide an elcoent of accountability that is 
more closely r'*sled tc irtiat children need than are other, more 
diffuse or adult-centered measores such as satisfaction vith the 
scbooU If the teat performance of i:hildren could not be 
improved by the vork of school people^ then it would be unfair to 
evaluate achoola vith such standards. The uses of test data for 
policy decisiona are discuased in the policy section belov. At 
thia point, ve ahould note that the panel supports the 
formulation of tests by experts and the use of those test data by 
lay people including school boards and the general community. 
Moreover^ a majority of the panel supports reporting of test data 
broken dovu by students* social class. The position is a 
sensible one« First, the instructional ly Elective achool 
assumes that effect vill be TCai|ured and, as loi^t at the XB8 is 
defined vi^i respect to social class, those data are relevant. 
Second, reducing the unfortunate interaction betveen lov aocial 
class standing and lov school achievement ia good public policy. 
Reporting the data by social class allows us to set and modify 
our goals. There is a consistent strain in the panel* a 
deliberations to open up **instructional'ly effective" achools to 
all children. That recurred here as veil vhere the scores of all 
children were to be reported but presumably the ones used to 
judge the IE8 i^uld be these from poor families only. 

One important question vss not considered by the panel. 
Norm referenced atanJardised tests are designed to cut the test 
population at midpoint, half above and hslf belov. Hev York 
City, Pittsburgh and A^.lanta all enroll aubstantial numbers of 
minority students, all have been uffing the same teat, and all 
have had more than half their tested students above the median 
point for a oinisnLm of tvo c^^aecutive years. There are three 
possible conclusions from *that. Firat, acme have concluded that 
some systems are cheating and therefore the results are invalid. 
Others have included chat those systems are getting better and 
should be congratulated. The third possible conclusion is that 
the reaults are valid and the norm should be changed. Fragments 
of all three responses can be foui»l in current policy 
diicutsionSp Social scientists frequently comment on the social 
stratification function performed by achools. If the norms are 




rai««d, the politsMl •.onftqueacet for th« i^ortint ichool 
inprovenent efforts now uadenray acrot* the country will be 
severe. 

The group*! siulysis aleo eBphaiised the use of tcftt in 
eosjusctios with eUmoflo iaetrwction. In jeserel, the 
recoosended practice is diasaostic-prescriptive and geared to 
particular units within the corriculun. Coosercial publishers 
are good sources of tests premised oa their currieulus* This 
business of testing what is taught caa be pilloried as teaching 
to the test but whether that is bad or not depends on what is 
being seaaured and for w^-* purposes. If we want to find out 
wha£ children have learned in .elation to what they have been 
taught then tuere sniat be an "overlap" or "alignoent" between the 
content of instruction and of tests. 

Some {oembers of the panel were concerned not to overwheln 
the teacher with testing obligations; tioe spent testing is not 
avsilable ft' direct instruction. Others were concerned about 
the cost * :«sting. Even taking those caveats into account, the 
frequency .v use of instructional testing would Buch greater 
than the current practice of teating at narking periods generally 
for purposes of piscing the child in his or her ne»t class. The 
emerging Bsxin is that IES*s use the data they collect and thus 
the consequences of testing iopact both what the child and the 
teacher does next. In that regard, the computer systems 
necessary to support much more finely grained ptt;»il achievement 
evaluation systems already exist and are frequently 
underutiliaed. The cost to student engaged time is a more 
realistic barrier to more testing than' is the cost of collecting, 
analyzing, snd reporting the data. 

Two final points. The panel split on whether or not testing 
at the level of minimum competency diminished a child's 
sflpirations. The question seems to us to be more relevant to 
adults speculating alfeut children than to children faced with a 
series of transitional, ever increasing achievement thresholds. 
As with the other factors, the panel endorses goal setting close 
to the child and the local school. 

Curriculum Materials 

The idea of "curriculum" ordinarily includes both product 
and process, the texts snd how they are used. In order to parcel 
out the analysis, one team had to coocertrate narrowly on the 
artifacts that mediate, inform,^ guide, and perhaps determine 
clasaroon instruction because thtSse materials are related to 
general expectations shout how much of whst should be taught, in 
what sequences, at what grade levels. Measuring the power or 
efficacy of t»isting msttrials for children fron poor families is 
also important because so much money is invested in their 
development and purchase. In Hew Tork City, for example, half of 
the State's yearly per pupil textbook allowance in the early 
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grades it ipent oo coopumable bmaic literacy uteriala. 

Of the factors contributia} to the XES, the panel 
CMur.iatently r^ced curriculw Mterlala laat. Fart of that la 
attributable to the narroMeaa of the definitions aoat ia due to 
the weight other fms^tozB^ eapecijUJ.7 te«chera« If one of 

the aajor properties of an XE8 ia a diasnoatic--preacriptive cycle 
roughly akin to Haatery Learning^ then why vonld not cvrricolua 
support of the 'teacher aa evaluator and diagnoatician' be fairly 
central the lES? The panel conaiatently atreaaed 

relationahipa and teacher behaviora and juat m conaiatently 
rejected mechanist iCt rational t aequential conceptions of the 
I£S« This will diaappoitt practitionera vho rightly search for 
recipes but the good neva ia that^ aince the contribution of 
curriculum mater*' «la ia relatively alightt a majority of the 
panelists beli that the XES could be achieved whether or not 
an indiv ideal achool poaseaaed optimal texta and materiala. 
Similarly* the panel ws unimpreased with the effect of alternate 
curricula on grouping for inatruction* Even though the basic 
skills acquisition research supports direct (reading) inatniction 
to largt groups, the panel vaa indifferent to thia part of the 
question* 

The folklore about classroom teaching is split on the extent 
to which texta control teaching. Text adoptiona are thought to 
have grave consequences because so many teachers plan their 
lessons from the texts. On the other hand,, it is generally 
believed to be impossible to '^teacher proofs any curriculum> that 
is, to determine the behavior of teachers by having provided text 
materials and other support. The panel too, waa divided. 
Although materiala were not highly ranked^ the best of existing 
curricula nonetheless do support good instruction and do provide 
some rough outer boundariea for practice. The contribution of 
ma t er is 1 s to an XES comes not from by-paaaing the teacher 
directly to the student, but tram having affected how teachers 
teach. The revolution in electronic learning is likely to short 
circuit that route, a proposition that ia teated daily in the 
video arcades of America. Bat in the absence of public policies 
to the contrary, the effect of the electronic revolution will 
vary by social class. Half the households in the U. S. t the top 
half, will have home computera by 1990. 

The panel had been asked to respond to the assertion; 

Text and other materiala or products neceasary to support 
the creation and maintenance of an instructional ly effective 
school exist.... There is a basic skills curriculum well 
enough developed to facilitate the acquisition of word 
recognition skills, basic apelling, number facta, etc* 

The panel's agreement waa confident and referenced **Diatar,*' 
'^Open Court,** and **Break through to Literacy* ** Again, the prior 
focus on literacy was not i»een aa precluding a later emphasia oii 
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conpiehtntion. vriting, or other «biliti««. 

Our own pcrtpective tupportt the eaphAfii on the lES «• • 
"people place" but puts wore veight on the near term proipective 
breakthroughi in curriculuiB. All innovations ere partly 
technical and partly procedural. The recent hiitory of achool 
refora ahova nore iaiproveiDent £n the proceaa of gaining entry to 
the achool and working with teachers than it does improvement in 
the content, aubatance, or product of thoae changes. Aa the 
mature producta of curriculum development efforta more accurately 
reflect the reaulta of baaic reaearch on teaching and learning 
that will change. The factors discussed elsewhere in this 

report aligning texta and inatruction, maximizing time-on-task 

and direct instruction, matching teaching atyles with learning 

styles, using diagnostic-prescriptive sequences, etc. will 

increasingly be reflected in curriculum materials and to good 
effect. 

Policy 

The biggest obstacle to more schools becoming more 
r.nstructionally effective has to do with attitudes and beliefs 
about what is possible given the state of the art and science of 
teaching and learning for poor children. Because of that, the 
three most important policy implications from this research are 
as follows. 

First, INSTRUCTIONALLY EFFECTIVE SCHOOLS EXIST and can be 
used as an orientation, a benchmark, a aet of aspirations and a 
source of practical guidance. Pedagogy has changed and is 
becoming more powerful. Some schools are instruct i anally 
effective, more can be. 

Second, there is a aet of lOiOMS FEATURES WHICH PROVIDE 
USEFUL, OPERATIONAL GUIDANCE to prt .t itioners, policy makers and 
xesearchers. Practitioners and researchers use knowledge in 
different ways and demand different assurances. Because progress 
toward the lES reats so heavily on **at practitionprs believe is 

possible, the knowledge base of the lES that is, doing more 

research is unusually important. But, while that is going on, 

we should all be clear that there are substantive reasons having 
to do with children's outcomes that make school improvement an 
urgent priority, now. 

Third, INSTRUCTIONALLY EFFECTIVE SCHOOLS CAN BE REALIZED 
WITHIN EXISTING RESOURCES. While more money would be helpful, it 
is not necessary. While more autonomy and discretion especially 
for building principals would be helpful, it is not necessary. 
Improvements can and should begin now, with what we already have. 
And the outccnnes from those improvements should then translate 
into more resources for needy schools. 

5? 
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The burden of the policy implicationi falls uMniiaously and 
eophatically on local education authorities and on the achool 
building. Attitudes and beliefs are key to aspirations and 
school administrators are the pa arount audience that needs to 
understand the IES« Although the panel vould probably dissent 
fro© our interpretation, we believe that virtually all of the 
prescriptiojus in every oni» of the factor areaa (e-g. i teaching, 
pupil achievenent evaluation, etc.) require the leadership and 
involveaent of the school principal. Every point in our analysis 
has implications for the principal. 

Our own sussary of the major findings, by policy area, 
f ollov8« 

Adm in i str j |itors 

( 1 ) Administrators need to re-caphasise instructional 
leadership probably at the expense of some business management. 

(2) They need to set high, child-centered achievement goa?s 
and in »ome locales that will risk the harmony of the school's 
adult culture.* They vill need courage and political support in 
that. 

(3) For instructional leadership to be successful it must be 
credible and that will require training for practitioners. 

Teachers 

i'k) The knowledge base is best developed here. Teachers 
should be encouraged by ^he convergence of research on a limited 
set of process and product factors linked to the efficacy of 
their work with children. 

(5) That convergence has implications for the traditional 
autonomy now accorded virtually every teacher in every classroom. 
In the future, professional practice will have to be selected 
from a smaller set. 

(6) Teachers as faculties are the preferred locus of 
improvement efforts. While the lES has implications for each 
teacher as an individual, the lES is an effective organirati o 
dealing with children over the course of their school experience. 

OrjLsn i zatipPPX CI imate 

(7) The organikational characteristics of the lES are its 
task orientation (concentrated nearly exclusively on basic skills 
acquisition until that is securely in place) and its high 
expectations of staff and students. 



♦Clark and Lotto dissent from this and argue the importance 
of staff satisfaction as a precursor to student achievement. 



erJc 



53 

in 



(8) Vhil€ the lES by definition t&rolli ehildren fron poor 
fmilies, school Wards should drsv school sttcndsnce linss to 
uximise tbs contribution vhich hettrogeneout student body 
populations sake to SLhicvenent, 

Pupil AchievCTignt Testing 

(9) Stsndsrdired tests ere the best oversll mssure of the 
lES. They need to be reported by social class, shared videlyi 
and used to guide policy. 

CIO) Testing linked to instructionsl units needs to be 
increaied in order to saxiaise the overlap or alignment betveen 
vhat if taught and vhat is tested. 

(11) Test data used to menage instruction compared to test 
f*»^» v«?d tc sanage instructors (e.g., ranking less and isore 
effective teachers) are tvo separate questions. The former makes 
more difference for realising the lES than the latter. 

Curriculum 

(12) Good materials exist although they are not videly 
recognised. More are being developed but the central finding is 
thst schools and teachers can become instruct ionally effective, 
vith a vide variety of materials. 

Finally, for every factor area, and for all policy and 
practical uses, there is a similar message. The stste of the art 
and science of tesching and learning for poor children is getting 
better. Because substantial improvements are being incr'^asingly 
documented, there is reason for educators to return to vhat 

brought many of them into the profession in the first place a 

desire to help the o^st needy children* 



For further information including the 
team reports and propositlonal inventoriea 
for aach of the lES domains* i#rita: 

ERIC/Center for Education Policy Hanagement 
School of Education 
University of Oregon 
Eugene, Orago:i 97403 



54 

17 



